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Abstract 

We give a high precision polynomial-time approximation scheme for the supremum 
of any honest n-variate (n + 2)-nomial with a constant term, allowing real exponents as 
well as real coefficients. Our complexity bounds count field operations and inequality 
checks, and are polynomial in n and the logarithm of a certain condition number. 
For the special case of polynomials (i.e., integer exponents), the log of our condition 
number is sub-quadratic in the sparse size. The best previous complexity bounds were 
exponential in the sparse size, even for n fixed. Along the way, we partially extend the 
theory of ^-discriminants to real exponents and exponential sums, and find new and 
natural NPjR-complete problems. 



1 Introduction and Main Results 

Maximizing or minimizing polynomial functions is a central problem in science and engineer- 
ing. Typically, the polynomials have an underlying structure, e.g., sparsity, small expansion 
with respect to a particular basis, invariance with respect to a group action, etc. In the 
setting of sparsity, Fewnomial Theory |Kho91] has succeeded in establishing bounds for the 
number of real solutions (or real extrema) that depend just on the number of monomial 
terms. However, the current general complexity bounds for real solving and nonlinear op- 
timization (see, e.g., |BPR06t ISOSj IPar03] ) are still stated in terms of degree and number 
of variables, and all but ignore any finer input structure. In this paper, we present new 
speed-ups for the optimization of certain sparse multivariate polynomials, extended to allow 
real exponents as well. Along the way, we also present two new families of problems that 
are NPjR-complete, i.e., the analogue of NP-complete for the BSS model over M. (The 
BSS model, derived in the 1980s by Blum, Shub, and Smale |BSS89] . is a generalization of 
the classical Turing model of computation with an eye toward unifying bit complexity and 
algebraic complexity.) Our framework has both symbolic and numerical aspects in that (a) 
we deal with real number inputs and (b) our algorithms give either yes or no answers that 
are always correct, or numerically approximate answers whose precision can be efficiently 
tuned. 

* ' ''' {pppebay ,dcthomp}@sandia.gov . Sandia National Laboratories, PO Box 969, MS 9159, Livermore, 
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States Department of Energy under contract DE-AC04-94AL85000. 

'I'ro jas@math.tamu.edu . TAMU 3368, Department of Mathematics, Texas A&M University, College 
Station, Texas 77843-3368, USA. Partially supported by NSF grant DMS-0915245, NSF CAREER grant 
DMS-0349309, and by the United States Department of Energy, Office of Defense Programs. 
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To state our results, let us first clarify some basic notation. Recall that [xj is the greatest 
integer not exceeding a real number x, and that R* is the multiplicative group of nonzero 
elements in any ring R. 

Definition 1.1 When aj G M", the notations aj = (ctij, . . . ,a,nj), x""^ = x^^'^ ■ ■ ■ Xn"'\ and 
X = {xi, . . . ,Xn) will be understood. If f{x) := Xljli where Cj G M* for all j, and 
the Qj are pair-wise distinct, then we call f a (real) n-variate m-nomial, and we define 
Supp(/) := {ai, . . . , am} to be the support of f . We also let J^n,m denote the set of all n- 
variate \ m\-nomial^ and, for any m>n + l, we let J-'*m'^J^n,m denote the subset consisting 
of those f with Supp(/) not contained in any {n — l)-flat. We also call any / G J-"*^ an 
honest n-variate m-nomial (^or honestly n-variate o 

For example, the dishonestly 4-variate trinomial —l + y/7x\x2x\x\ — e'^^x^^^^x^^^x^'^^^x'^^'^^^ 
(with support contained in a line segment) has the same supremum over as the honest 
univariate trinomial — 1 + \/lyi — e^^yf^'^' has over IR+. More generally, via a monomial 
change of variables, it will be natural to restrict to J^n,n+k (with k>l) to study the role of 
sparsity in algorithmic complexity over the real numbers. 

To characterize a natural class of problems with efficiently computable numerical an- 
swers, we introduce the notion of a High Precision Polynomial Time Approximation 
Scheme: We let HPTAS denote the class of functions (p : (]RU{±oo})°° — > ]RU{±oo} such 
that, for any e>0, there is an algorithm guaranteed to approximate (f){x) to within a 1 + e 
factor, using a number of arithmetic operations polynomial in size(x) and log log p (When 
4>{x) = we will instead require an additive error of e or less. When 0(x) G {±cxd} we will 
require the approximation to be ±oo, with the correct sign, regardless of e.) Our notation is 
inspired by the more familiar classical family of problems FPTAS (i.e., those problems ad- 
mitting a Fully Polynomial Time Approximation Scheme), where instead the input is 
Boolean and the complexity need only be polynomial in size(x) and ^. The complexity class 
FPTAS was formulated in |ACGKM-SP99] and a highly-nontrivial example of a problem 
admitting a FPTAS is counting matchings in bounded degree graphs |BGKNT07j . 

Remark 1.2 For a vector function = (0i, . . . , 0^) : ]R°° — > (MU oo)'^ it will be natural to 
say that cf) admits an HPTAS iff each coordinate of (pi admits an HPTAS. o 



1.1 Sparse Real Optimization 

The main computational problems we address are the following. 

Definition 1.3 Let M.^ denote the positive real numbers, and let SUP denote the 
problem of deciding, for a given (/, A) G I |J ]R[x'^ | aGM"] 1 x M, whether snp^^^n f > 

VnGN / + 

A or not. Also, for any subfamily T C UneN^f-^" I ^ ^ we let SUP(J-') denote 

the natural restriction o/ SUP to inputs in T. Finally, we let FSUP (resp. FSUP(J-')^ 
denote the obvious functional analogue of SUP (resp. SUP(J-')^ where (a) the input is 

^Here we allow real coefficients, unlilfe |BRS09) where the same notation included a restriction to integer 
coefficients. 
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instead {f,e)E I |J ]R[x" | aGM"] ) x IR+ and (h) the output is instead a triple 



nGN 

{x, V, A) e (M+ U {0, +00})" X X (M U {+00}) 
with X = {xi, . . . ,Xn) (resp. \) an HPTAS for x* (resp. \*) where X* := sup^jgi^n / = 
lim^^^* /(a;") for some x* = {xl, . . . , x* ) e (M+ U {0, +00})". 

Note that SUP is a decision problem while FSUP is a functional problem, i.e., the 
answers to FSUP involve real numbers while the answers to SUP are simply "Yes" or "No". 

Remark 1.4 Taking logarithms, it is clear that our problems above are equivalent to max- 
imizing a function of the form g{y) = YliLi CiC"-^"^ over M", and allowing paths to suprema 
to be parametrized via rays (instead of monomial curves) extending to Pj^ if need be. When 
convenient, we will use the latter notation but, to draw parallels with the algebraic case, we 
will usually speak of "polynomials" with real exponents, o 

We will need to make one final restriction when optimizing n-variate m-nomials: we 
let J^n*n+k denote the subset of J^n,n+k consisting of those / with Supp(/) 3 O. While 
technically convenient, this restriction is also natural in that level sets of {n + /i;)-nomials in 
•^n*n+k become zero sets of (n + A;')-nomials with k' < k. Note also that checking whether 
the real zero set of an /gM[xi, . . . , x„] is nonempty (a.k.a. the real (algebraic) feasibility 
problem) is equivalent to checking whether the maximum of — is or greater. So it 
can be argued that the NP-hardness (and NP]R-hardness) of SUP has been known at least 
since the 1990s [BCSS98j . However, it appears that no sharper complexity upper bounds in 
terms of sparsity were known earlier. In what follows, our underlying notion of input size, 
including a variant of the condition number, is clarified in Definition 12. II of Section ETT] below, 
and illustrated in Example 11.61 immediately following our first main theorem. Likewise, the 
underlying complexity classes are classified in Section 11.21 

Theorem 1.5 We can efficiently optimize n-variate {n + k)-nomials over M" for k <2. 
Also, for k a slowly growing function of n, optimizing n-variate (n + k)-nomials over M" is 
NP^-hard. More precisely: 

0. MSUP(U„gN^rn+i) and FSUP (U„,N^:;+i) areznNCl 

1. SUP(U„eN-^Cn+2)ePM anc? FSUP (U„eN-^::n+2)e HPTAS. 

2. For any fixed 5>0, SUP[ |J J^** , n ]R[xi, . . . ,x„]\ is NP^-complete. 

^0<5'<5 ' 

Example 1.6 Suppose e > 0. A very special case of Assertion (1) of Theorem \1.5\ then 
implies that we can approximate within a factor of 1 + e — for any real nonzero Ci, . . . , Cn+2 
and D — the maximum of the function 

fix) : = ci + C2 (xf ■ ■ ■ + C3 {x^ ■ ■ ■ +■■■+ (cn+2xr '^"^ " " " a:^."^'^"''") , 

using a number of arithmetic operations linear in n^(log(n) + logD) + log log-. The best 
previous results in the algebraic setting (e.g., the critical points method as detailed in IS08^ . 
or by combining IBPROdf and the efficient numerical approximation results of IMP98^ ) would 
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yield a bound polynomial in n^D^ + log log - instead, and only under the assumption that D G 
N. Alternative approaches via semidefinite programming also appear to result in complexity 
bounds superlinear in D"^ (see, e.g., fPar03[ \LasO(A iDNOSi. \KM09f ). and still require D . 
Moving to Pfaffian/Noetherian function techniques, fUVU^ allows arbitrary real D but still 
yields an arithmetic complexity bound exponential in n. It should of course be pointed out 
that the results of WPROa \MP98l MR \Par03l \LasOa \DN08l \KM09[. \GVO^ apply to real 
polynomials in complete generality, o 

Theorem 11.51 thus gives a significant speed-up for a particular class of analytic functions, 
laying some preliminary groundwork for improved optimization of (n + A;)-nomials with k 
arbitrary. Our advance is possible because, unlike earlier methods which essentially revolved 
around commutative algebra (and were more suited to complex algebraic geometry), we are 
addressing a real analytic problem with real analytic tools. Theorem 11.51 is proved in Section 
13.21 below. Our main new technique, which may be of independent interest, is an extension 
of ^-discriminants (a.k.a. sparse discriminants) to real exponents (Theorem 12.91 of Section 

E3D. 

Our algorithms are quite implementable (see Algorithm 13.21 of Section 13. 2p and derived 
via a combination of tropical geometric ideas and ^-discriminant theory, both extended to 
real exponents. In particular, for n-variate (n + l)-nomials, a simple change of variables 
essentially tells us that tropical geometry rules (in the form of Viro diagrams |GKZ94t Ch. 
5, pp. 378-393], but extended to real exponents), and in the case at hand this means that 
one can compute extrema by checking inequalities involving the coefficients (and possibly 
an input A). Tropical geometry still applies to the n-variate (n -t- 2)-nomial case, but only 
after one evaluates the sign of a particular generalized ^-discriminant |§ More precisely, an 
n-variate m-nomial / (considered as a function on M") with bounded supremum A* must 
attain the value A* at a critical point of / in the nonnegative orthant. In particular, the 
nonnegative zero set of / — A* must be degenerate, and thus we can attempt to solve for A* 
(and a corresponding maximizer) if we have a sufficiently tractable notion of discriminant to 
work with. 

So our hardest case reduces to (a) finding efficient formulas for discriminants of n-variate 
m-nomials and (b) efficiently detecting unboundedness for n-variate m-nomials. When 
m = n -t- 2, (a) fortuitously admits a solution, based on a nascent theory developed fur- 
ther in jCR09] . We can also reduce Problem (b) to Problem (a) via some tropical geometric 
tricks. So our development ultimately hinges deriving an efficient analogue of discriminant 
polynomials for discriminant varieties that are no longer algebraic. 

Example 1.7 Consider the trivariate pentanomial 

fix) :=ci + C2xr + csxl^xf^ + 04x2009 + c^xl^xl'^^'xs, 
with Ci , . . . , C4 < and C5 > . Theorem \2.11\ of Section \2.4\ then easily implies that f attains 



a maximum of A* on M.^ iff f — X* has a degenerate root in . Via Theorem \2.9[ of 
Section below, the latter occurs iffbl^ici — A*) ^^02^03^04* — b^ib^2^^i^^i(^i vanishes, where 
b:= (61, 62; ^3; b^, —65) is any generator of the kernel of the map ip : — > defined by the 



^For n-variate (n + 3)-noniials, knowing the sign of a discriminant is no longer sufficient, and efficient 
optimization still remains an open problem. Some of the intricacies are detailed in [DRRSOTl IBHPR09) . 
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normalized so that 65 >0. In particular, such a b can be easily 



computed via a 5 determinants 0/ 4 x 4 submatrices (via Cramer's Rule), and we thus see 
that X* is nothing more than Ci minus a monomial (involving real exponents) in C2, . . . ,05. 
Via the now classical fast algorithms for approximating log and exp lBre76^ , real powers of 
real numbers (and thus X*) can be efficiently approximated. Similarly, deciding whether X* 
exceeds a given X reduces to checking an inequality involving real powers of positive numbers. 



o 



1.2 Related Work 

Let us first point out that Linear Programming (LP) forms an interesting parallel to 
the complexity issues we encounter: while LP admits polynomial-time algorithms relative 
to the Turing model, polynomial-time algorithms for linear programming relative to the 
BCSS model over M (a.k.a. strongly polynomial-time algorithms or polynomial arithmetic 
complexity) remain unknown. Also, the arithmetic complexity of LP appears to be linked 
with a fundamental invariant measuring the intrinsic complexity of numerical solutions: the 
condition number (see, e.g., |VY93t ICCP03] ). Our results reveal a class of non-linear 
problems where similar subtleties arise when comparing discrete and continuous complexity. 

So let us recall the following basic inclusions of complexity classes: NCj^ ^ Pr C NPk 
|BCSS98l Ch. 19, Cor. 1, pg. 364]. (The properness of the latter inclusion remains a famous 
open problem, akin to the more famous classical P=NP question.) Let us also recall that 
NC^ is the family of real valued functions (with real inputs) computable by arithmetic 
circuit^ with size polynomial in the input size and depth 0(log'= (Input Size)) (see |BCSS98[ 
Ch. 18] for further discussion). 

The computational complexity of numerical analysis continues to be an active area of 
research, both in theory and in practice. On the theoretical side, the BCSS model over 
M has proven quite useful for setting a rigourous foundation. While this model involves 
exact arithmetic and field operations, there are many results building upon this model that 
elegantly capture round-off error and numerical conditioning (see, e.g., |CS99l [A.BKM09] ). 
Furthermore, results on Pk and NPr do ultimately impact classical complexity classes. For 
instance, the respective Boolean parts of these complexity classes, BP(Pir) and BP(NP]r), 
are defined as the respective restrictions of Pr and NPr to integer inputs. While the best 
known bounds for these Boolean parts are still rather loose — 

P/PolyCBP(PK)CPSPACE/Poly [ABKM09J, 
NP/PolyCBP(NPK)CCH tABKM09] . 
— good algorithms for the BSS model and good algorithms for the Turing model frequently 
inspire one another, e.g., jKoi99l IBPR 06J. We recall that P/Poly, referred to as non- 
uniform polynomial-time, consists of those decision problems solvable by a non-uniform 
family of circuit^ of size polynomial in the input. CH is the counting hierarchy PP U 
PP^^ U PP^^'''' U ■ ■ ■ , which happens to be contained in PSPACE. 

•^This is one of 2 times we will mention circuits in the sense of complexity theory: Everywhere else in this 
paper, our circuits will be combinatorial objects as in Definition 12.71 below . 

■^i.e., there is no restriction on the power of the algorithm specifying the circuit for a given input size 
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The number of natural problems known to be NPiR-complete remains much smaller than 
the number of natural problems known to be NP-complete: deciding the existence of a 
real roots for multivariate polynomials (and various subcases involving quadratic systems or 
single quartic polynomials) |BCSS98[ Ch. 5], linear programming feasibility |BCSS98l Ch. 
5], and bounding the real dimension of algebraic sets |Koi99] are the main representative 
NPg-complete problems. Optimizing n-variate (n + n'')-nomials (with 6 > fixed and n 
unbounded), and the corresponding feasibility problem (cf. Corollary 11.101 below) . now join 
this short list. 

While sparsity has been profitably explored in the context of interpolation (see, e.g., 
|KYn7[ l(;LLn9] ) and factorization over number fields |Len99[ IKKOBi lAKSO?] . it has been 
mostly ignored in numerical analysis (for nonlinear polynomials) and the study of the BCSS 
model over C and M. For instance, there appear to be no earlier published complexity upper 
bounds of the form SUP (J^i,m) ^Pr (relative to the sparse encoding) for any m>3, in spite 
of beautiful recent work in semi-definite programming (see, e.g., |Las06[ [I)N08[ lKM09j ) that 
begins to address the optimization of sparse multivariate polynomials over the real numbers. 
In particular, while the latter papers give significant practical speed-ups over older techniques 
such as resultants and Grobner bases, the published complexity bounds are still exponential 
(relative to the sparse encoding) for n-variate (n + 2)-nomials, and require the assumption 
of integer exponents. 

We can at least obtain a glimpse of sparse optimization beyond n-variate {n + 2)-nomials 
by combining our framework with an earlier result from |RY05] . The proof is in Section l3^ 

Corollary 1.8 

(0) Using the same notion of input size as for FSUP (cf. Definition \2.1\ below), the positive 
roots of any real trinomial in J^i^^ fl M.[xi] admit an HPTAS. 

(1 ) SUP (J"** n M[xi]) G Pr and FSUP (J"** n M[xi]) G HPTAS. 

As for earlier complexity lower bounds for SUP in terms of sparsity, we are unaware of 
any. For instance, it is not even known whether SUP(]R[xi, . . . ,x„]) is NP^-hard for some 
fixed n (relative to the sparse encoding). 

The paper [BRS09j . which deals exclusively with decision problems (i.e., yes/no answers) 
and bit complexity (as opposed to arithmetic complexity), is an important precursor to the 
present work. Here, we thus expand the context to real coefficient and real exponents, work 
in the distinct setting of optimization, and derive (and make critical use of) a new tool: 
generalized ^-discriminants for exponential sums. As a consequence, we are also able to 
extend some of the complexity lower bounds from |BRS09j as follows. (See Section 13.21 for 
the proof.) 

Definition 1.9 Let FEASk (resp. FEAS+ j denote the problem of deciding whether an 
arbitrary system of equations from [j^^^Wyx"- \ a G W] has a real root (resp. root with 
all coordinates positive). Also, for any collection T of tuples chosen from UfcneN(^k" I '^^ 
M"'])'', we let FEASm(J') (resp. FEAS+(J')^ denote the natural restriction o/FEASr (resp. 
FEAS+ ) to inputs in T . o 
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Corollary 1.10 For any 5>0, FEASk[ [j J"**^^^,, n . . . , ] and 

neN ' 
0«5'<<5 

FEAS+[ U J^**n_^_J^s' ^ ^[xi, . . . ,Xn]\ are each NP^-complete. 

' 0<<5'<<5 



2 Background 

2.1 Input Size 

To measure the complexity of our algorithms, let us fix the following definitions for input 
size and condition number. 

Definition 2.1 Given any subset A = {cii, . . . , flm} C M" of cardinality m, let us define A 
to he the (n + 1) x m matrix whose j— column is {1} x Qj, and /3j the absolute value of the 
determinant of the submatrix of A consisting of those columns of A with index in a subset 
J C {1, . . . , m} of cardinality n + \. Then, given any / G J-"* ^ written f{x) = X^I^i Cja;'^* , we 
define its condition number, C{f), to be 

maxjs, |ci|,^}^ X ^ H max* (^3, ^) , 

#J=n+l 

where max* (a, b, c) is max{a, b, c} or a, according as max{6, c} is finite or not. 

Throughout this paper, we will use the following notions of input size for SUP and 
FSUP; The size of any instance (/, A) o/ SUP (resp. an instance {f,s) o/FSUPj is 

log(max* (^3,|A|,^)) +logC(/) (resp. logC(/);. o 

While our definition of condition number may appear unusual, it is meant to concisely 
arrive at two important properties: (1) log C(/) is polynomial in n log deg / when / G J^n,n+k^ 
M[xi, . . . ,Xn] and k is fixed, (2) C(/) is closely related to an underlying discriminant (see 
Theorem 12.91 below) which dictates how much numerical accuracy we will need to solve 
FSUP. We also point out that for / G Z[xi, . . . ,Xn], it is easy to show that logC(/) = 
0{nS{f)) where S{f) is the sparse size of /, i.e., S{f) is the number of bits needed to write 
down the monomial term expansion of /. For sufficiently sparse polynomials, algorithms 
with complexity polynomial in S{f) are much faster than those with complexity polynomial 
in n and deg(/). |Len99l IKK061 IAKS071 IKY071 IGLL091 IBRS09j provide other interesting 
examples of algorithms with complexity polynomial in S{f). 

2.2 Tricks with Exponents 

A simple and useful change of variables is to use monomials in new variables. 

Definition 2.2 For any ring R, let R^^^ denote the set of m x n matrices with entries 
in R. For any M = [rriij] G M"^" and y = {yi, . . . ,yn), we define the formal expression 
y^ := {y^^'^ ■ ■ -yn"^'^ , ■ ■ ■ jyT^'" ■ ■ -yli"'")- We call the substitution x := y^ a monomial 
change of variables. Also, for any z:={zi, . . . , Zn), we let ). Finally, 

let GL„(]R) denote the group of all invertible matrices in M"^". o 
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Proposition 2.3 (See, e.g., \LRW03[ Prop. 2].) For any f/, G M"^", we have the formal 
identity (xy)^^ = (x^)^ (y^)^ . Also, if detU 7^ 0, then the function mij{x) := x^ is an 
analytic automorphism o/M", and preserves smooth points and singular points of positive 
zero sets of analytic functions. Finally, U gGL„(]R) implies that e^^(]R")=]R" and thatmu 
maps distinct open orthants ofW^ to distinct open orthants ofW^. ■ 

A consequence follows: Recall that the afRne span of a point set ^CM", Aff^, is the 
set of real linear combinations ^ae^^"*^ satisfying ^ag^Ca = 0. To optimize an f ^F^^+i it 
will help to have a much simpler canonical form. In what follows, we use 7^ for set cardinality 
and Cj for the i— standard basis vector of M". 

Corollary 2.4 For any f E J^**n+i we can compute c G M and i E {0, . . . ,n} within NC]^ 
such that f{x) :=c + Xi + ■ ■ ■ + Xg — — ■ ■ ■ — x„ satisfies: (1) f and f have exactly the 
same number of positive coefficients and (2) /(M") =/(]R") . 

Proof: Suppose / has support ^= {0, 02, ... , ctn+i} and corresponding coefficients Ci, . . . , c„+i. 
Letting M denote the n x n matrix whose i— column is Oj+i, Proposition 12. 3[ via the substi- 
tution x = y^ , tells us that we may assume that / is of the form ci + C2X1 + ■ ■ ■ + c„+ix„. 
Moreover, to obtain /, we need only perform a suitable positive rescaling and reordering of 
the variables. In summary, c is simply the constant term of / and i is the number of positive 
coefficients not belonging to the constant term — both of which can be computed simply by 
a search and a sort clearly belonging to NCj^. ■ 

Note that we don't actually need to compute to obtain i: is needed only for the 

proof of our corollary. 

A final construction we will need is the notion of a generalized Viro diagram. Recall 
that a triangulation of a point set A is simply a simplicial complex S whose vertices lie in 
A. We say that a triangulation of A is induced by a lifting iff it its simplices are exactly 
the domains of linearity for some function that is convex, continuous, and piecewise linear 
on the convex hull o^ A. 

Definition 2.5 Suppose ^cM" is finite, dimAff^ = 'ri, and A is equipped with a triangula- 
tion S induced by a lifting and a function s : A — > {±} which we will call a distribution 
of signs for A. We then define a piece-wise linear manifold — the generalized Viro 
diagram V^(S, s) — in the following local manner: For any n-cell C G S, let Lc be the 
convex hull of the set of midpoints of edges of C with vertices of opposite sign, and then 
define V^(S, s) := IJ Lq. When ^ = Supp(/) and s is the corresponding sequence of 

C an n-cell 

coefficient signs, then we also call Vs(/) := V^(S, s) the (generalized) Viro diagram of 
/. o 

We use the appelation "generalized" since, to the best of our knowledge, Viro diagrams have 
only been used in the special case AcZ"- (see, e.g.. Proposition 5.2 and Theorem 5.6 of 
[GKZ941 Ch. 5, pp. 378-393]). Examples of Viro diagrams in Section [23] below. 

Viro originally used his diagrams (with A C Z"') to construct real algebraic varieties 
with prescribed topological behavior (see, e.g., |Vir84] ) . In particular, for certain /, one can 
sometimes find a triangulation S such that Vs(/) is isotopic to the set of positive zeroes of 
/. Making this precise requires a consideration of discriminants. 



smallest convex set containing. 
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2.3 Generalized Circuit Discriminants and 
Efficient Approximations 

Our goal here is to extract an extension of .4-discriminant theory sufficiently strong to prove 
our main results. 

Definition 2.6 Given any A = {ai, . . . , C of cardinality m and Ci, . . . , G C*, we 
define V^CP^~^ — the generalized ^-discriminant variety — to be the closure of the 
set of all [ci : ■ ■ ■ : Cm] G Pc""*^ such that g{x) = Yl'iLi Cic""^'^ has a degenerate root in C". In 
particular, we call f an ra-variate exponential m-sum. o 

To prove our results, it will actually suffice to deal with a small subclass of ^-discriminants. 



Definition 2.7 We call ^cM" a (non-degenerate) circuill^ iff is affinely dependent, 
but every proper subset of A is affinely independent. Also, we say that A is a degenerate 
circuit iff A contains a point a and a proper subset B such that a E B, A \ a is affinely 
independent, and B is a non-degenerate circuit, o 

For instance, both \II and 1^. are circuits, but I . . is a degenerate circuit. In general, for 
any degenerate circuit A, the subset B named above is always unique. 

Definition 2.8 For any A C of cardinality m, let denote the set of all n-variate 
exponential m-sums with support A. o 

There is then a surprisingly succinct description for when .4 is a non-degenerate 
circuit. The theorem below is inspired by |GKZ94t Prop. 1.2, pg. 217] and |GKZ94t Prop. 
1.8, Pg. 274] — important precursors that covered the special case of integral exponents. 

Theorem 2.9 Suppose A = {ai, . . . ,0^+2} C M" is a non- degenerate circuit, and let b := 
(61, ... , bn+2) where bi is (—1)* times the determinant of the matrix with columns 1 x ai, . . ., 
({■) denoting omission). Then: 

r n+2 bi ] 

-Z- V^C I [ci : • • • : c„+2] ePc"^^ : H |- =1 j ■ Also, {bi, ... ,bn+2) can be computed m NC^. 
2. There is a [ci : ■■■ : Cn+2] G Pr^^ with (i) sign(ci6i) = ■■■ = sign(c„+2&n+2) and 



n+2 



(a) n (sig^(^iCj)Q/6j)'^^^"^''^'^'^''' = 1 iff the real zero set of g{y) ■.= Y^^=i Cic'^^'^ contains 



1=1 



a degenerate point (. In particular, any such ( satisfies e'^''^ = sign(6iCi)6j/cj for all i, 
and thus the real zero set of g has at most one degenerate point. 

Theorem 12.91 is proved in Section |3] below, and is an important tool to help us relate positive 
zeroes of fewnomials and generalized Viro diagrams. As a warm-up, it is worth noting that 
the range of certain exponential sums supported on circuits can be described quite simply. 



^This terminology comes from matroid theory and has nothing to do with circuits from complexity theory. 
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Lemma 2.10 Suppose A = {ai, . . . , aj/} cM" is a circuit and aj/ lies in the relative interior 
0/ Convjai, . . . , aj/_i}. Suppose also that g{y) := Y^i=i^i^"''^ '"'^^^ Ci,...,Cj/_i < and 
Cj/>0. Finally, leth={hi, . . . ,hji)EW \{0} he any vector such that biai + ■ ■ ■ + bj'aj/ = 0, 
bi + ■ ■ ■ + bji =0, and bji <0. Then: 

0. 61, ... , 6,v_i >0. 



1. Ifaj/ = O then sup^^gj^n g{y) = Cji + bji \jY^i=i{ci/biY* and this value is attained exactly 
on an {n + 2 — j')-flat. 

2. If O^A and j'<n + 2 then snpy^^n g{y) = +00 ^ {-Cj^/byp > nC"i^(c*/&i)^" ■ 

Proof: Assertion (0) follows immediately since aji is a convex linear combination of ai, . . . , Oj 
and we are assuming bj/ <0. 

To prove the remaining assertions, let us first recall the Weighted Arithmetic-Geometric 
Inequality |HLP88t Sec. 2.5, pp. 16-18]: For any nonnegative real numbers wi, ui, . . . , Wk, Uk > 
with wi + ■ ■ ■ + Wk>0, we have 

uiiH huifc — V 1 k 1 

with equahty iff all Ui with Wi > are equal. Substituting k := j' — 1, and Wi = bi and 
Ui = ^^^-^ for all 2 G {1, . . . , j' — 1}, we immediately obtain 



(In particular, it is easily checked that the last inequality is invariant under scaling of the 
vector b since 61 + ■ ■ ■ + 6^/ = 0.) Note also that equality holds in the last inequality iff 

'^^^ ^ — — ''-1 ^ and the last system of equations has an {n + 2 — j')-flat as its solu- 



61 

tion set: this follows immediately upon taking log and using the fact that 02— ai, . . . , aji^i—ai 
are linearly independent. 

Assertion (1) then follows immediately. 

Assertion (2) then follows easily via a geometric construction: Let v be any vector normal 
to the affine hull of 

If {—Cj'/bj')^^^' > Y[i=i{'^i/^iT' then, by Inequality (*) and its conditions for equality, 
g{y)>0 for some value ?/ G M". By construction, g{y + cv) = fi(c'^) where d is the distance 
from O to the affine hull of ai, . . . , aji, and thus sup^g]gn g{y) = +00. 

Taking the negative, {—Cf /bji)~^3' <Y\^iSi{ci/biY^ clearly implies that g{y) is nonpositive 
for all i/GM". So we are done. ■ 

We will also need a variant of a family of fast algorithms discovered independently by 
Brent and Salamin. 

Brent-Salamin Theorem lBre76 . Sal76 / Given any positive x,e>0, we can approximate 
\ogx and exp(x) within a factor of 1 + e using just 0{\ \ogx\ + log log arithmetic opera- 
tions. ■ 

While Brent's paper [Bre76j does not explicitly mention general real numbers, he works with 
a model of floating point number from which it is routine to derive the statement above. 
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2.4 Unboundedness and Sign Checks 



Optimizing an / G J^^n+i ^ill ultimately reduce to checking simple inequalities involving 
just the coefficients of /. The optimum will then in fact be either oo or the constant term 
of /. Optimizing an / G J-'**„+2 would be as easy were it not for two additional difficulties: 
deciding unboundedness already entails checking the sign of a generalized ^-discriminant, 
and the optimum can be a transcendental function of the coefficients. 

To formalize the harder case, let us now work at the level of exponential sums: let us 
define Qn,m, Gn,my Gn*m ^'^ ^c the obvious respective exponential m-sum analogues of 
J^n,m, J^n,my J^n*^- Recall that Conv^ is the convex hull of A. 

Theorem 2.11 Suppose we write g G Qn*n+2 form g{y) = Yll=i^i^"''^ '"'^^^ — 

{oi, . . . ,an+2}- Let us also order the monomials of f so that i3:={ai, . . . ,aj'} is the unique 
non- degenerate sub-circuit of A and let b:={bi, . . . ,6„+2) where bi is (—1)* times the deter- 
minant of the matrix with columns 1 x ai, . . . , 1 x a^, . . . , a„+2 ({■) denoting omission). Then 
suPygRn g{y) = +oo <^==^ one of the following 2 conditions holds: 

1. Cj>0 for some vertex aj of Conv A not equal to O. 

2. O ^ B, we can further order the monomials of f so that aji is the unique point of 
B in the relative interior of B, cj < for all j with j ^ j' and aj ^ O, Cji > 0, and 

nil (sign(V)f7) <1- 
Finally, if sup g{y) = X* <+oo, then X* = Cj, or X* is the unique solution to 

/ ^,_;^.\ sign(f)y)!)j / \sign(6y)6i 

(sign(6j')-^^ — ) X J] (sign(6j/)|^) =1 with {cj — X*)bjbji > 0; where the 

last equation for X* holds iff: 

3. OeB, we can further order the monomials of f so that aj> is the unique point of B in 
the relative interior of B, Cj<0 for all j^j', and Cj/>0. 

It is easily checked that Cibibji, . . . , Cj'_i6j'_i6j' > when Conditions (2) or (3) hold. Note 
also that Conditions (1) and (2) can not hold simultaneously. While the 3 cases above may 
appear complicated, they are easily understood from a tropical perspective: our cases above 
correspond to 4 different families of generalized Viro diagrams that characterize how the 
function g can be bounded from above (or not) on M". Some representative examples for 
n = 2 are illustrated below: 





2/2 

For example, the first two illustrations are meant to encode the fact that there exist di- 
rections in the positive quadrant along which g increases without bound. Similarly, the 
last 2 illustrations respectively show cases where g either approaches a supremum as some 
Hi — )■ — oo or has a unique maximum in the real plane. 

Proof of Theorem 12. lit First, we identify the graph of g over M" with the real zero set 
Z oi z — g{y)- Since the supremum of g is unaffected by a linear change of variables, we can 
then assume (analogous to Corollary 12. 4p that g is of the form 

c + e^i H h e^^ - e^^+i e^" + c'e"'^. 

(Note in particular that a linear change of variables for an exponential sum is, modulo ap- 
plications of exp and log, the same as a monomial change of variables.) Note also that 
the classical Hadamard bound for the determinant guarantees that \ogC{g) increases by 
at worst a factor of n after our change of variables. Let P denote the convex hull of 
{O, ei, . . . , e„, e„+i, a}. We have 2 cases to consider. 

(supyg]K« g{y) = -\-oo): We must prove that Condition (1) or Condition (2) holds iff sup^gi^n g{y) = 
+00. Let us start with the "only if" direction. 

In particular, if Condition (1) is true, then we can pick a vertex aj of Conv^ with Cj>0, 
and by our simplifications above, this vertex lies in {ei, a}. Now let v be any outer 

normal to aj. It is then easily verified that g{y) becomes unboundedly large asy-v increases, 
and thus sup^gjgn giy) = +oo. 

On the other hand, if Condition (2) is true, then (permuting coordinates if necessary) 
we must have that a lies on the relative interior of a facet of the form {ei, . . . , ej'_i} with 
j' <n + 1. By Assertion (2) of Lemma [2.10[ we again obtain sup^gj^n g{y) = +oo. 

Showing that supy^j^n g{y) = +oo implies the truth of Condition (1) or Condition (2) is 
a deeper matter but can be handled as follows: Via a minor variation of the moment map 
(see, e.g., |Ful93j ) one can give a homeomorphism if : M""*"^ — > Int(P) that extends to a map 
(f encoding the "limits at toric infinity" of Z in terms of data involving P. (See also [LRW03t 
Sec. 6].) In particular, ip{Z) intersects the facet of P parallel to the yi coordinate hyperplane 
iff Z contains points with yi coordinates approaching — oo. Similarly, the function g is 
unbounded iff <^(2') intersects a face of P incident to e^+i and some point in {ei, . . . , e„, a}. 
This correspondence immediately accounts for unboundedness of g{y) implying Condition 
(1) or Condition (2). ■ 

(supyg^n g(y) <+oo): We must show that the supremum of g{y) is either the constant term 
of g (when Condition (3) fails) or the unique solution to the stated equation (when Condition 
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(3) holds). 

Indeed, when Condition (3) fails and the supremum of g{y) is finite, then Conditions 
(1) and (2) must fail as well. We must then have that cj < for all vertices aj of Conv^. 
If Conv^ is not a simplex then sup^gjjn g{y) is clearly the constant term of g. Otherwise, 
thanks to the proof of Assertion (2) of Lemma I2.10[ there are vectors y,v & M" such that 
g{y) < and g{y — cv) is a non-increasing function function of c. Moreover, as c +oo, 
all exponentials e"* *^^"™-' tend to 0, save for the constant term. So sup^gj^n g{y) is again the 
constant term of g. 

When Condition (3) holds, and ajr = 0, we can then conclude immediately via Assertion 
(1) of Lemma [2. 101 If aj/y^O then, via an argument similar to that of the proof of Assertion 
(1) of Lemma [2.10[ we obtain the desired equation for A*. In particular, via Theorem 12. 9[ 
the equation for A* is merely finding a perturbation of the constant term of g so that the 
real zero set of g has a degeneracy. ■ 



3 The Proofs of Our Main Results: Theorems 2.9 and 



1.5L and Corollaries 11.101 and 11.8 

We go in increasing order of proof length. 
3.1 The Proof of Theorem [2791 

Assertion (1): It is easily checked that Zc{f) has a degenerate point ( iff 



A 



In which case, (cie"^'^, . . . , c„+2e""+2'^)"^ must be a generator of the right null space of A. 
On the other hand, by Cramer's Rule, one sees that (61, . . . , is also a generator of the 

right null space of A. In particular, A a non-degenerate circuit implies that bi^O for all i. 
We therefore obtain that 







0" 










(cie"i<. 



a.n + 2-C 



)=a(6i, . . . ,6„+2) 



for some aEC*. Dividing coordinate- wise and taking absolute values, we then obtain 
(|ci/6i|e''i-^''('^), . . . , |c„+2/6„+2|e''"+2'^''(^)) = . . . , |a|). Taking both sides to the vector 
power (61, ... , &„_|-2) we then clearly obtain 

(|Ci/6i|*i •••|c„,+2/6n+2r"+') (e(''i"i+-^"+2a„+2).Re(C)^^|(j|6i+...+6„^ gjj^^g 



n+2 

obtain Yl 

1=1 



. , bn+2) = O, we thus 
1. Since the last equation is homogeneous in the Cj, its zero set in P^"^^ 



actually defines a closed set of [ci : ■ ■ ■ : c„+2]- So we obtain the containment for V^. 

The assertion on the complexity of computing (61, . . . , 6„+2) then follows immediately 
from the classic efficient parallel algorithms for linear algebra over M [Csa76] . ■ 

Assertion (2): We can proceed by almost exactly the same argument as above, using one 
simple additional observation: e"'^''^ G M+ for all i when C ^ I^- So then, we can replace our 
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use of absolute value by a sign factor, so that all real powers are well-defined. In particular, 
we immediately obtain the "<^=" direction of our desired equivalence. 

To obtain the "^>" direction, note that when Z]^(J2^^^ Cie"''-"^) has a degeneracy (, we 
directly obtain e""''' =sign(6iCi)6j/Q for all i (and the constancy of sign(6jCj) in particular). 
We thus obtain the system of equations 

/ (a2-ai)-C (a„+i-ai)<\ _ / b2Ci ^"+1^1 

V ; • • • ; J ybiC2 ' ' ' ' ' bic„+i 

and 02 — ai,...,a„+i — Oi are linearly independent since ^ is a circuit. So, employing 
Proposition 12. 3[ we can easily solve the preceding system for ( by taking the logs of the 

coordinates of I ... , ^±i^ ) . ■ 

3.2 Proving Corollary 11.101 and Theorem 11.51 

Corollary 11.101 and Assertion (2) of Theorem II. 5t Since our underlying family of 
putative hard problems shrinks as 6 decrease, it clearly suffices to prove the case 6 <1. So 
let assume henceforth that 6 <1. Let us also define QSATjg to be the problem of deciding 
whether an input quartic polynomial / G UneN ^[^ii • • • ; ^n] has a real root or not. QSATj^ 
(referred to as 4-FEAS in [ BCSS98] ) is one of the fundamental NP^-complete problems (see 
Chapter 4 of [BCSS98J). 

That SUP G NPk follows immediately from the definition of NP^. So it suffices to 
prove that SUP/ |J T** g, fl Mfxi, . . . , is NPiR-hard. We will do this by giving 

^Q<5'<S ' 

an explicit reduction of QSATjg to SUPf |J H ]R[xi, . . . |, passing through 

^0<5'<5 ' 

FEAS+f U ^:*,.nM[xi,...,a;„]) along the way. 

^0<5'<<5 ' 

To do so, let / denote any QSATjg instance, involving, say, n variables. Clearly, / has no 

(77, + 4\ 
^ 1 monomial terms. Letting QSAT_,_ denote the natural variant of QSATj^ 

where one instead asks if / has a root in M" , we will first need to show that QSAT^ is NP]r- 
hard as an intermediate step. This is easy, via the introduction of slack variables: using 2n 
new variables {xf}.^-^^ and forming the polynomial /^(x^) := f{xf — Xi, . . . — it 
is clear that / has a root in M" iff has a root in M^". Furthermore, we easily see that 
size(/^) = (16 + o(l))size(/). So QSAT+ is NP^-hard. We also observe that we may 
restrict the inputs to quartic polynomials with full-dimensional Newton polytope, since the 
original proof for the NPiR-hardness of QSATjg actually involves polynomials having nonzero 
constant terms and nonzero xj terms for all i [BCSS98j. 

So now let / be any QSAT^ instance with, say, n variables. Let us also define, for any 

M G N, the polynomial tM^z) := 1 + +^ H h z^^^ - (M + l)zi ■■■zm- One can then 

check via the Arithmetic-Geometric Inequality |HLP88] that is nonnegative on M^^, with 

_^ 4\ ^ 

a unique root at z = (1, . . . , 1). Note also that has no more than I monomial 



terms. Forming the polynomial F{x, z) := /(x)^ + tuiz) with M 



4 

+ 
4 



^ \ 2/<5' 



we see 
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that / has a root in iff F has a root in M""^^. It is also easily checked that F eJ-'^j^_^_i^ 
with k < N^' , where N ■. = n + M and 0<S' <5. In particular, 



*<i"t*V'< 



A \ 2/5' 



s 

= M^ <{n + Mf . 

So we must now have that FEAS+( M neN -^** , s flMbi, . . . is NP^-hard. (A small 
digression allows us to succinctly prove that FEASrI M neN J^** , ^ flMbi, . . . , x„l 1 is NPr- 

I 0<5'<<5 I 

hard as well: we simply repeat the argument from the last paragraph, but use QSATjg in 
place of QSAT^, and define z) :=/(x)^ + tM^zf, . . . , z]^) instead.) 

To conclude, note that F{x,z) is nonnegative on M". So by checking whether —F has 
supremum > in M", we can decide if F has a root in M". In other words, 
/ 

SUP 



U -^Tn+n^' ^ ^[^1; • • • ; ^n] | must be NP]R-hard has well. So we are done. 
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\0<J'<5 

Assertion (0) of Theorem ll.St Letting (/, e) denote any instance of FSUP (UneN -^n^+i) 

first note that via Corollary 12.41 we can assume that /(x) = Ci + Xi + ■ ■ ■ + — x^+i - — x. 

after a computation in NCj^. Clearly then, / has an unbounded supremum iff 1. Also 
if £ = 0, then the supremum of / is exactly Ci. So FSUP(|J„gj^ J'**^.^!) e NCj^. That 
SUP([J^gpj G NC]^ is obvious as well: after checking the signs of the Cj, we make 

merely decide the sign of ci — A. ■ 

Remark 3.1 Note that checking whether a given f EJ^n,n+i ^^es in J^* can be done within 
NC^.' one simply finds (i = dim Supp(/) in NC^ by computing the rank of the matrix whose 
columns are 02 — ai, . . . , — ai (via the parallel algorithm of Csanky \Csa76l ), and then 
checks whether d = n. o 

Assertion (1) of Theorem II. 5t We will first derive the HPTAS result. Let us assume 
/ G J^**n+2 observe the following algorithm: 

Algorithm 3.2 

Input: A coefficient vector c:= (ci, . . . , Cn+2), 0, (possibly degenerate) circuit A = {ai, . . . , 0^+2} 
of cardinality n + 2, and a precision parameter e>0. 

Output: A pair _ (x. A) G (M+ U {0, +00})" x (M U {+00}) 

with X = (xi, . . . , x„) (resp. X) an HPTAS for x* (resp. X*) where /(x) := Yl'^=i CiX"-^ and 

A*: = sup^gK!^ / = lim^^^. /(x) for some x* = (x*,. . . ,x;)g(M+ U {0,+oo})". 

Description: 

1. If Ci > for some i with Oj 7^ O a vertex of Conv^ then output "/ tends to +00 
along a curve of the form {ct"'}(_>-|-oo " and STOP. 

2. Let h := (hi, . . . ,bn+2) where bj is (—1)-' times the determinant of the matrix with 
columns 1 x ai, . . . , 1 x a^, . . . , a„+2 ({■) denoting omission). If b or —b has a unique 
negative coordinate bj/, and Cji is the unique negative coordinate of c, then do the 
following: 
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(a) Replace b by — sign(6j/)6 and then reorder b, c, and A by the same permutation so 
that bj> < and [bi>0 iff i< j']. 

(b) If ai O for all i E {1, . . . and YLi=i \ ) < ^ then output 
"f tends to +00 along a curve of the form {ct"j' }t^+oo " and STOP. 

(c) If aj = for some j ^{1, . . . ,j'} then output "f{z) tends to a supremum of A 

as z tends to the point x on the (j'— 2) -dimensional sub-orbit corresponding 

to {oi, . . . , aj'} . where xGM+~^ is the unique solution to the binomial system 

' • • • '-^ ~ ■ ■ ' feic„+i )' 

X is a {1 + e)-factor approximation of x, A is the unique solution of 

(sign(5,0^) X n (sign(&,')f:) =1 

with {cj — X)bjbj> > 0, and A zs a (1 + e)-factor approximation^ of X; and STOP. 

3. Output "f approaches a supremum of Cj as all with incident to O 
approach . " and STOP. 

Our proof then reduces to proving correctness and a suitable complexity bound for Al- 
gorithm 13.21 In particular, correctness follows immediately from Theorem I2.11[ So we now 
focus on a complexity analysis. 

Steps 1 and 3 can clearly be done within NC]^, so let us focus on Step 2. 

For Step 2, the dominant complexity comes from Part (b). (Part (a) can clearly be done 
in NC]^, and Part (c) can clearly be done in NC^ via Csanky's method [Csa76j .) The latter 
can be done by taking the logarithm of each term, thus reducing to checking the sign of a 
linear combination of logarithms of positive real numbers. So the arithmetic complexity of 
our algorithm is 0(logC(/) + log log -) and we thus obtain our HPTAS result. 

The proof that SUP (IJneN n+2) ^ almost completely identical. ■ 

Note that just as in Remark 13. checking whether a given / G /n,n+2 lies in J^n,n+2 
be done within NC^ by computing (i = dimSupp(/) efficiently. Moreover, deciding whether 
a circuit is degenerate (and extracting B from A when A is degenerate) can be done in NC^ 
as well since this is ultimately the evaluation of n + 2 determinants. 

3.3 The Proof of Corollary [TTSl 

Assertion (0) : Since the roots of / in IR+ are unchanged under multiplication by monomials, 
we can clearly assume f EJ^l\r\W\Xi\. Moreover, via the classical Cauchy bounds on the size 
of roots of polynomials, it is easy to show that the log of any root of / is 0(logC(/)). We can 
then invoke Theorem 1 of [RY05j to obtain our desired HPTAS as follows: If Z):=deg(/), 
|RY05[ Theorem 1] tells us that we can count exactly the number of positive roots of / 
using 0(log D) arithmetic operations, and e-approximate all the roots of / in (0, R) within 
©((logD) log (Dlog j)) arithmetic operations. Since we can take logi? = 0(logC(/)) via 
our root bound observed above, we are done. ■ 

^We compute x and A via Proposition 12.31 and the Brent-Salamin Theorem. 
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Assertion (1): Writing any / e F**^^ n R[xi] as f{x) = Ci + C2x"2 + c^x"-^ + with 
02 < 03 < 04, note that / has unbounded suprcmum on M+ iff C4>0 So let us assume C4<0. 

Clearly then, the supremum of / is attained either at a critical point in ]R_|_ or at 0. 
But then, any positive critical point is a positive root of a trinomial, and by Assertion (0), 
such critical points must admit an HPTAS. Similarly, since / is a tetranomial (and thus 
evaluable within 0(logdeg(/)) arithmetic operations), we can efficiently approximate (as 
well as efficiently check inequalities involving) sup^gjj^ /. So we are done. ■ 
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